# GPT2 Architecture

Unconditional driving video generation model trained on the commaVQ dataset

ProtGPT2 is a protein language model based on the GPT2 architecture, capable of generating novel protein sequences while retaining key features of natural proteins.

A Chinese classical poetry generation model based on the GPT2 architecture, pre-trained by UER-py, capable of generating Chinese classical poetry.

Spanish large language model based on Transformer architecture, trained on web-crawled content from the Spanish National Library between 2009-2019